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SUMMARY 


In any practical interaction with a computer, the user is required to 
formulate, phrase and enter the problem for solution through a series of 
steps. One very common and important characteristic of this procedure 
is that the operator may be interrupted at any point and required to attend 
to other tasks before resuming. Such interruption could have pronounced 
effects on the time and errors made while completing the computer task. 

In order to study the effects different logic systems might hav<» on in- 
terrupted operation, an Algebraic calculator and a Reverse Polish Notation 
calculator were compared when trained users were interrupted during pro- 
blem entry. The RPN calculator showed markedly superior resistance to 
interruption effects compared to the AN calculator although no significant 
differences were found when the users were not interrupted. 

Causes and possible remedies for interruption effects are speculated. 
It is proposed that because interruption is such a common occurrence, it 
be incorporated into comparative evaluation tests of different logic system 
and control/display system and that interruption resistance be adopted as a 
specific design criteria for such design. 


INTRODUCTION 


Designing the user -computer interface has been a decided challenge 
and will continue to assume growing importance. One of the vital aspects 
concerns interfacing the human user's cognitive abilities and characteris- 
tics with those of the computer, i.e. its logic program. 


The work reported here is based on the unpublished M. S. thesis of 
Mrs, Mary McCarthy. 


/ 
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Grace (1970. ) suggested that a new relationship should be regarded as 
existing within a man-machine logic system, and that the logic component 
introduces a new set of considerations for the human factor discipline. 

Man-computer cooperation in problem solving places emphasis on the 
design of the console devices for efficient communication of information 
between man and the computer. This mainly involves the computer dis- 
play and the console manip'alator y devices such as the switches, light pens, 
and plugs. The display and console manipulatory devices serve not only 
to transmit information between the human to the computer but also, in 
varing degrees to record and establish memory of this action and its con- 
sequence. (Zeigler and Sheridan, 1965. ) The form and content of the 
information conveyed by these devices must be such as to aid the human in 
his thought processes, and thus make it easier for the operator to perform 
multitasks more efficiently. 

In 1977 , Durding, Becker and Gould studied the human memory skills 
as to how they aid or hinder data processing. They considered that mem- 
ory organization depends on the task condition (computer memory) and if 
this were optimized then the human memory would be used more efficiently. 
However, at best, in tlie real world situation, the human mind seldom is 
without distraction, as for example unexpected interruptions. Enstrom 
and Rouse in 1977, did considerable work in analyzing how the human's 
allocation of attention will affect the input-output of the human relative to 
the computer. 

It is obvious that the display and device^ of the data processing ma- 
chines immediately effect the transfer of information, yet there ir. a more 
fundamental area where man and machine meet, where the reasoning powers 
of man interact with the very essence of the machine, its logic system. 

It is clear that this logic interfacing is less than ideal. However, one 
of the most significant challange is to specify useful design principles and 
evaluation criteria for logic design in addition to its functional character- 
istics in a manner similar to specifying physical characteristics such as 
button placement, size, etc,, relating to proper computer hardware design 
for human use. 

Common (and common sense) criteria for evaluating alternative logic 
design at the user level ordinarily include the number of key strokes re- 
quired, number of errors made, and the time required to enter the problem 
and obtain the results. 

Card (1979) found no difference between RPN (Reverse Polish Notation) 
and AN (Algebraic Notation) calculators on the basis of the time required 
to enter and solve problems of various degrees of complexity. However, 
a recent study (Agate & Drury, 1980) found significant differences in per- 
centage errors and average •completion times between AN and RPN with 
RPN showing the more favorable performance for both measures. On the 
other hand, a different study (Kasprzyk, Drury, Bialas, 1979) found 
smaller significant differences between AN and RPN with RPN still superior. 
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One of the testing principles in evaluating alternative designs that do 
not show clear performance differentiation is to apply increasing amounts 
of user or environmental stress, simulating conditions which could reason- 
ably arise, and compare the alternative design performances. The design 
maintaining a higher level of performance over the wider range of stress 
could reasonably be judged the superior design. The assumption holds that 
the user is taxed less by the more stress-tolerant design, which would seem 
to be a sensible design criteria (Chapanis, 1959). 

This principle of user stress was applied to ,a performance re-evalua- 
tion of an RPN and an /vN hand calculator. The purpose of the experiment 
was not to evaluate particular calculators per-su but rather to devise a test 
methodology for evaluating different logic system designs in a practical, 
user -oriented manner. The calculators were used because they provided 
existing (and presumably optimized) examples of alternative logic designs 
for solving identical problems. 

The "stress" applied to the user simulated real world conditions often 
encountered in which the problem solving task is interrupted part way through 
for some reason, with a subsequent diversion of attention. After the inter- 
ruption, the operator is required to resume the task. Examples of this type 
of interruption are familiar to pilots, controllers, and others in a multi-task 
environment. A more homely example might be that of a housewife program- 
ming a microwave oven, being interrupted by a child or other distractions and 
then resuming the programming. In fact, anyone using a hand calculator has 
commonly experienced being interrupted during a lengthy series of key strokes 
with subsequent consequences. 

The issue raised by the interruption is its impact on task compl .tion. 

It is a reasonable assertion that a superior design would, among other vir- 
tues, show the least difference on the primary entry task betwee*" interrupt- 
ed and uninterrupted performances. Common effects of an interruption in- 
clude causing the user to loose the place, and/or to start over. 

Thus a "good" logic design should, in principle, permit the user to re- 
sume the teisk after interruptions with negligible effects on subsequent per- 
formance. A corollary principle is that the user should be able to repro- 
gram at any point making maximum use of previously programmed materi- 
al. An example of this could be found among pilots programming an on- 
board navigational computer through a series of waypoints with associated 
altitudes, speeds and times. If interrupted during this task, the pilot 
should be able to resume as though no interruption occurred and/or, if nec- 
essary, reprogram at any time to meet new requirements. A clearly in- 
ferior logic design would require the pilot to begin again from the beginning 
effectively wasting any time previously spent on programming material 
which remains a subject of the existing pvoblem. 

There arc at least t' o major components to a logic system for human 
use. One component ' ne logic system which on hand calculators mani- 
fests itselt as the mc....^r in wh’ch a problem must be phrased for entry 
(e.g. Reverse Polish Notation or Algebraic Notation), The other compon- 
ent is the console unit of input and display systems whose purposes include 
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verification, feedback, and resultant display. 

One could assume that the logic system should be compatible with the 
user's own "logic system" or cognitive characteristics of problem phrasing, 
whether learned or innate, while the console system should at least aid dur- 
ing the process of problem entry particularly if information processing is 
required (Ziegler, Sheridan, 1965). Except for very novice users, problems 
are never entered from a prewritten list of key strokes (except possible for 
lengthy programs entered into a programmable calculator). Thus since the 
hand calculator user works directly from mind to calculator, errors in solu- 
tion (barring key stroke mistrikes) as well as the time taken to enter a pro- 
blem (sequence of Key strokes) could be attributable to mismatches between 
the human and machine logic systems and inadequacy of the display system. 
Any distraction interrupting the user during the entry process would put 
stress on the logic interface and on the adequacy of the console system. 

The objective of our experiment was to test the effects of interruption 
during the calculation task on errors and completion time for AN and RPN 
logic systems as examples of different logic systems designed for the same 
purposes. The purposes of the experiment were to examine task inter- 
ruption - a. common occurrence - as a potential sensitive probe of perform- 
ance with different logic systems and to shed further light on potential dif- 
ferences between AN and RPN calculators in a simulated multi-task envi- 
ronment. Based on the equivocal findings in performance between the two 
types of calculators when the user is not interrupted, the superior design 
would be expected to show the ies‘'“r difference between interrupted and 
noninterrupted performances. 


METHODOLOGY 


The Hewlett Packard Model 3 IE and the Texas Instrument Model TI57 
hand calculators were chosen as examples embodying the RPN and the AN 
logic, respectively. Both calculators are examples of scientific calcula- 
tors equipped to solve problems of considerable formulation complexity. 


Four problems of different prima facie complexities were formulated 
to span a range of types that mi^t be encountered. The problems were: 

(1) : ^))) = (-17.7206) 

6 x V27 
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+ sin 37 
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( 2 ) 


254 

762 

321 

854 

952 
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369 
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1_ 

(7460) 


(3) 3 X (4^^ " = (4.7000434) 


1.2 X 10^^ + 3.45 X 10*"^ 

^ ^ c"^r"T"x /I eCO8 60 « 
(4f 5 ) X 7 + (3 X 5 


= (1.577 X 10^^) 


The answers in parentheses were, of course, not presented to the subjects. 
A.t this point, the reader is encouraged to imagine which of the above pro- 
blems, if any, might reveal the largest performance differences between 
the two calculators. 

In order to contrast RPN with AN, the first problem is shown in Fig- 
ure 1 as It would be entered into each calculator. 
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Figure 1. A Test Problem as It Would be Entered in Reverse 
Polish Notation and in Algebraic Notation . 


The test procedure required two groups of 24 subjects each, with one 
group for each calculator. Each group was further divided 'ro two sub- 
groups of 12 subjects each; one subgroup to solve the four problems with- 
out interruption and the other subgroup to solve each problem with a stan- 
dardized 1 minute interruption beginning 12 seconds into each problem. 
During the 1 minute interruption, subjects were asked to w’’ite the multipli- 
cation table of nines, eights, etc. After I minute elapsed, subjects were 
asked to stop multiplying and resume solving the test problems. All sub- 
jects had paper and pencil available at all times. 

A short explanation of the experiment was read to each subject and 
questions answered. The subject was given the test calculator, paper, 
pencil and the four problems, each on a separate paper placed face down. 
Subject was instructed to turn over one test paper cn GO and proceed to 
solve the problem. The Interruption subjects were interrupted 12 sec- 
onds into the problem by "INTERRUPT" to perform the multiplications 
for one minute. At RESUME, these subjects returned to the problem sig- 
nalling its completion by saying "FINISHED". The noninterrupted sub- 
jects proceeded from GO to FINISHED without interruption. 

Four times were recorded by stopwatch. Tq = GO, = first key 
pressed, T 2 = first key pressed after RESUME , T^ = FINISHED. 

For the noninterrupted groups, only Tq, T^, T^ were recorded. Prob- 
lem answers werj recorded in all cases. 

The 48 subjects had each been using a calculator for more than five 
years, most frequently on a daily basis. The subject population comprised 
undergraduate and graduate engineering students (60%) and faculty mem- 
bers (40%) of Engineering, Mathematics and Physics and one engineer 
from. Hewlett-Packard. There were 27 males and 21 females ranging in 
ago from 19 to 35 years. Subjects for each group (RPN, AN) were chosen 
from those owning and using a calculatur with the respective notatior sys- 
tem although all considered the particular test calculator as somewhat un- 
familiar from the one they oumed. f .ejects were allowed to practice with 
the test calculator. Approximately 40% of the RPN subjects and 25% of the 





AN subjects were faculty^ members although the faculty members reported 
using their calculators less frequently than did the nonfaculty subjects. 


RESULTS 


In comparing the two types of calculators the following six measures 
were computed, 

(1) Ty - Total (uninterrupted) time to perform the problem 

(2) T, - Total time to perform the problem when interrupted 

(interruption time of 1 minute removed) 

(3) T-, - Net effect on solution due to the interruption = T - T 

(4) T^ - Time to press first key 

(5) Tl - Time to press first key after the interruption ceases 

^ (T 2 - time at RESUME) 

(6) E - Incorrect solutions. 


Table 1 presents average and standard deviation values of the first three 
measures for each of the four problems as performed on the Reverse Polish 
(RPN) and Algebraic (AN) calculators. The fractional and unbiased percent- 
age differences in solution times of each calculator are also shown. 


The measures are computed for the 12 subjects in each of the four 
test sections 


TABLE 1 


Interrupted An Uninterrupted 
Problem Entry Times For A 
Reverse Polish and An Alge- 
braic Notation Hand Calcul- 
ator. 
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I’igure 1 presents just T^, Tj and from Table I for both calculators. 
The test method allows only one sample of Tj^ to be computer for each pro- 
blem in each group. However, the variance of T^^ was computer as the sum 
of the two independent sample mean (Ty, Tj) variances and the correspond- 
ing standard deviation is shown in Table 1 for each Tj^ value. 
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Figure 1. Interrupted and Uninterrupted Problem 
Entry Times for Reverse Polish and 
Algebraic Notation. 


Both Table 1 and Figure 1 show that there was a consistently greater 
lengthening of solution time (Tj^) on each problem for the Algebraic Nota- 
tion compared to the Reverse Polish calculator when their operators were 
interrupted at the task. This difference was statistically confirmed by a 
student t test using the Tj^ vulue for each problem as sample data points 

and comparing the four values from the RPN with those of the AN calculator. 

( t = 5.037, p<.02). Table 1 shows that this statistically significant find- 
ing also represents a large unbiased percentage difference of at least il4% 
for the two calculators. 

A similar student t test showed that the uninterrupted times did not dif- 
fer significantly between the two calculators which is in agreement with sev- 
eral previous findings but contrary to Agate & Drury. Although the inter- 
rupted solution times (Tj) were consistenly longer on each problem for the 

Algebraic compared to the Reverse Foolish Notation calculator, this difference 


-6b2- 






\ 


was not significant with the exception of problem number 2 (t = 2.47, p<.05). 

The data were also reduced to obtain the time required before pressing 
the first key at problem start (T and again following the end of the inter- 
ruption (T^). The latencies are shown in Table 2. 


TABLE 2 

First Key Press Latency Times At Problem Start And 
Following the Interruption. 



The only consistent finding among these latencies is that resuming the entry 
task after interruption required less latency than when first beginning it and 
the addition problem required the least latency of the four problems. There 
was no significant difference between the initial or between the post interrup- 
tion latencies for the two calculators. It might have been assumed that the 
greater lengthening of entry time under interruption for AN compared to RPN 
would correspond to a similarly greater post interruption latency. However, this 
is not the case. If anything, the AN latencies appear a bit shorter (not sig- 
nificantly) rather than longer compared to those for RPN, 

Incorrect solutions were also compared for the two calculators on each 
problem interrupted and uninterrupted and the results are set out in Table 3. 

Although problem two showed the fewest incorrect solutions out of 12 
(except for the AN - interrupted) only the Reverse Polish calculator - unin- 
terrupted) showed a statistically significant difference between the problems 

\ (x^ = 7.33, p=<'.06). 
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TABLE 3 


Number of Incorrect Solutions (Out of IZ Possible /Problem) 
For The RPN And AN Calculators Working With And 
Without Interruption. 
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DISCUSSION 


Previous experiments were equivocal whether Reverse Polish Notation 
had an advantage over Algebraic Notations regardless of problem complex- 
ity. The no difference findings were reconfirmed in the present experiment 
when sugjects were not interrupted during problem entry. When subjects 
were interrupted, as might naturally happen in real life the problem entry 
time increased for both notation systems (calculators) over that required 
under no interruption. However, the average increase for the Algebraic 
Notation calculator was more than twice as g”eat as that for Reverse Polish 
Notation for the addition problem at the least and twenty- seven times as 
great at the most, or one of the complex problems. Regardless of the 
problem, the increase in entry time was longer for the AN calculator. 
Coincidently, although not statistically significant, more incorrect solutions 
occurred with the AN calculator as well. 

Although it is tempting to attribute the difference in entry times to the 
nature of logic or notation it is difficult to support this conclusion directly. 

If one or the other notation system is per se more compatible with the sub- 
jects’ own mode of problem organization, difference might be expected in 
the respective times taken to press the first key for each calculator either 
at the start of the problem or resuming after interruption. Presumably, 
these times might reflect the amount of "mismatch" between human and 
machine "logic" systems. However, these respective times were nearly 
identical for each calculator. , (Again,and although not statistically signif- 
icant, the addition problem required ^he least amount of this latency time 
which was also consistently less following the interruption than when just 
beginning the problem.) The negligible differences between key latencies, 
and between uninterrupted solution times suggests that the user can adapt 
to either notation system. 

It is, in fact, difficult to find the mechanism of the entry time length- 
ening (T ) in the interrupted mode. Neither the recording nor observa- 
N 

tional methods were sufficiently detailed enough to monitor each of the 
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individual key entry times. Examination of such a record might have sug- 
gested plausible mechanisms for these lengthenings. At present, and for 
lack of more detailed data, it could be assumed that any lengthening (T^) is 

manifested as a uniform slowing of entry, for whatever reason, after inter- 
ruption, It may be that problem recapitulation is necessary after the inter- 
ruption and that the AN system places more memory stress on the user re- 
sulting in a longer time to execute the problem. With the increased memory 
burden adding to the task difficulty, resources invested in doing the entry 
task can do less, decreasing user efficiency (Novon and Gopher, 1979). 

However, any mismatch between the human logic system, and the AN (or 
RPN) calculators thus can also be sought in key board and/or display 
differences. 

A potential explanation of the solution time differences under interrup- 
tion involves display rather than key board differences. The simple addi- 
tion problem of [ 5 -I- Z = (7)] as entered and displayed on each calculator is 
instructive for this purpose as shown in Figure 2. 
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Figure 2. Sample Entries of the Same Problem 
on HP(RPN) and TI(AN) Calculators. 


As presently constructed, the HP (RPN) calculator display differenti- 
ates between resultants and entries while the TI (AN) calculator does not. 
Of course, if the entry had exactly as many decimal places as the dis- 
played resultant, this difference would no longer hold. A second display 
difference appears in the familiar left-to-right concatenation of digits as 
they are entered on the HP mimicking the normal mode of writing as op- 
posed to the left shift of the entire digit string as a new numeral is enter- 
ed on the TI calculator. 

The HP display features may be a better aid to "place holding" during 
interruption than those of the TI calculator permitting a more rapid re- 
covery as the problem is resumed. 
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At present it is not unequivocabiy possible to attribute the large percent- 
age differences in interrupted solution tim ^s to notational or display differ- 
ences or both for the two calculators. 

However, from a practical point of view, the HP calculator (RPN nota- 
tion and display) is superior in terms of the shorter time taken to complete 
a problem when interrupted - a common real life occurrence - and would 
be recommended where many such computations must be made or where 
time is a critical factor. 

Since task interruption is a fact of life, and since it also degrades per- 
formance, it is reasonable that the logic/display design be as performance 
resistant to the interruption as possible. Tt is suggested that on computer 
systems without printers, the d: splay show simultaneously at all times the 
last datum entry and operation as well as the current resultant and that a 
review key permit sequential viewing of the previous few datum + operation 
pairs as though a key stroke list had been internally compiled for later 
display. Although no definite suggestion can be made for the notational 
system itself, it is possible that some hybred of the RPN and AN may be 
more compatible with the user's own m^des ox problem phrasing and 
recall. 

Further studies will be made of the notational and display features un- 
confuunded in search of the 'Ideftl" calculator which at this point could be 
said to produce identical interrupted and uninterrupted solution times re- 
gardless s of problem complexity in addition to other desirable features. 

For design and evaluation purposes, it is suggested that interrupted solu- 
tion times serve as one of the performance criteria. 
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